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Hits 


Search Query 
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Default 
Operator 


Plurals 


Time Stamp 


S2 


13 


track$4 same voicexml and 
(@ad<"20011221" 
@prad<"20011221" 
@rlad<"20011221") 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBI^_TDB 


OR 


ON 


2006/06/09 09:58 


S3 


103 


interpret$4 same voicexml and 
(@ad<"20011221" 
@prad<"20011221" 
@rlad<"20011221") 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM_TDB 


OR 


ON 


2006/06/09 09:43 


S5 


65 


((execut$4 interpret$4) same 
voicexml) and ((identif$4 locat$4 
detect$4 determin$4) same 
voicexml) and (@ad<"20011221" 
@prad<"20011221" 
@rlad<"20011221") 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM.TDB 


OR 


ON 


2006/06/09 12:47 


S8 


30 


(record$4 cacli$4 register$4 
foliow$4 monitor$4 track$4) same 
voicexml same execut$4 and 
(@ad<"20011221" 
@prad<"20011221" 
@rlad<"20011221") 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM_TDB 


OR 


ON 


2006/06/09 10:05 


S9 


12 


(identif$4 locat$4 detect$4) witli 
voicexml same document and 
(@ad<"20011221" 
@prad<"20011221" 
@rlad<"20011221") 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBI^_TDB 


OR 


ON 


2006/06/09 10:08 


SIO 


45 


(identif$4 locat$4 detect$4) with 
voicexml and (@ad<"20011221" 
@prad<"20011221" 
@rlad<"20011221") 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM.TDB 


OR 


ON 


2006/06/09 10:08 


Sll 


77 


(identif$4 locat$4 detect$4) with 
(VXML voicexml) and 
(@ad<"200H221" 
@prad<"20011221" 
@rlad<"20011221") 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBI^.TDB 


OR 


ON 


2006/06/09 10:14 


S12 


2 


(paus$4 stop$4 ceas$4 halt$4 
cancel$4 abort$4) with execut$4 
with (VXML voicexml) and 
(@ad<"20011221" 
@prad<"20011221" 
@rlad<"20011221") 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM_TDB 


OR 


ON 


2006/06/09 10:46 
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S15 


18 


(paus$4 stop$4 ceas$4 halt$4 
cancel$4 abort$4) same (VXML 
voicexml) and (@ad<"20011221" 
@prad<"20011221" 
@riad<"20011221") 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM_TDB 


OR 


ON 


2006/06/09 10:20 


S16 


11 


(load$4 download$4 install$4) same 
(VXML voicexml) and 
(@ad<"20011221" 
@prad<"20011221" 
@rlad<"20011221") 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM.TDB 


OR 


ON 


2006/06/09 10:22 


S17 


5 


(track$4 monitor$4) same (load$4 
download$4 install$4) same (VXML 
voicexml) and (@ad<"20011221" 
@prad<"20011221" 
@rlad<"20011221") 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM_TDB 


OR 


ON 


2006/06/09 13:38 


S18 


7 


compiler with (VXML voicexml) and 
(@ad<"20011221" 
@prad<"20011221" 
@rlad<"2001122r) 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM_TDB 


OR 


ON 


2006/06/09 10:25 


S21 


7 


(generat$4 creat$4 build$4 
construct$4) same (interpret$6) 
same (VXML voicexml) same 
compiler and (@ad<"20011221" 
@prad<"20011221" 
@rlad<"20011221") 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM_TDB 


OR 


ON 


2006/06/09 10:32 


S23 


51 


S22 not S21 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM_TDB 


OR 


ON 


2006/06/09 10:32 


S25 


5 


(identif$4 locat$4 detect$4) same 
(VXML voicexml) and ((paus$4 
halt$4 ceas$4 stop$4) with 
execut$5) and (@ad<"20011221" 

@prad<"20011221" 
@rlad<"20011221") 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM_TDB 


OR 


ON 


2006/06/09 10:45 


S26 


5 


(identif$4 iocat$4 detect$4 
occurrence) same (VXML voicexml) 
and ((paus$4 halt$4 ceas$4 stop$4) 
with execut$5) and 
(@ad<"20011221" 
@prad<"20011221" 
@rlad<"20011221") 


US-PGPUB; 
USPAT; 
USOCR; 
EPO; JPO; 
DERWENT; 
IBM TDB 


OR 


ON 


2006/06/09 10:45 
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S27 


2 


(paus$4 stop$4 ceas$4 halt$4 
cancel$4 abort$4 terminat$4) with 
execut$4 with (VXML voicexml) and 
(@ad<"20011221" 
@prad<"20011221" 
@rlad<"20011221") 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM_TDB 


OR 


ON 


2006/06/09 10:46 


S28 


20 


(paus$4 stop$4 ceas$4 halt$4 
cancel$4 abort$4 terminat$4) with 
(VXI^L voicexml) and 
(@ad<"20011221" 
@prad<"20011221" 
@riad<"20011221") 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBMJTDB 


OR 


ON 


2006/06/09 10:47 


S29 


11 


( terminat$4) with (VXML voicexml) 
and (@ad<"20011221" 
@prad<"20011221" 
@rlad<"20011221") 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM_TDB 


OR 


ON 


2006/06/09 10:48 


S30 


10 


( download$4) with (VXML 
voicexml) and (@ad<"20011221" 
@prad<"20011221" 
@rlad<"20011221") 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM_TDB 


OR 


ON 


2006/06/09 10:49 


S31 


33 


( load$4 install$4 download$4) with 
(VXML voicexml) and 
(@ad<"20011221" 
@prad<"20011221" 
@rlad<"20011221") 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM.TDB 


OR 


ON 


2006/06/09 10:49 


S33 


23 


S32 not S30 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBMJTDB 


OR 


ON 


2006/06/09 10:50 


S34 


67 


( locat$4 address) with (VXML 
voicexml) and (@ad<"20011221" 
@prad<"20011221" 
@rlad<"20011221") 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM_TDB 


OR 


ON 


2006/06/09 14:31 


S36 


18 


(paus$4 stop$4 ceas$4 halt$4 
cancel$4 abort$4) same (VXML 
voicexml) and (@ad<"20011221" 
@prad<"20011221" 
@rlad<"20011221") 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM_TDB 


OR 


ON 


2006/06/09 13:36 
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S37 


47 


(track$4 monitor$4) same (VXML 
voicexml) and (@ad<"20011221" 
@prad<"20011221" 
@rlad<"20011221") 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM_TDB 


OR 


ON 


2006/06/09 13:49 


S39 


40 


(check$4 determin$4 ) same 
execut$4 same (VXML voicexml) 
and (@ad<"20011221" 
@prad<"20011221" 
@riad<"20011221") 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM_TDB 


OR 


ON 


2006/06/09 13:54 


S40 


90 


( request$4) with (VXML voicexml) 
and (@ad<"20011221" 
@prad<"20011221" 
@rlad<"20011221") 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBMJTDB 


OR 


ON 


2006/06/09 14:32 


S41 


86 


( detect$4 identif$4 determin$4 
cliecl<$4) with (VXML voicexml 
(voice adj xml)) and 
(@ad<"20011221" 
@prad<"20011221" 
@rlad<"20011221") 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM_TDB 


OR 


ON 


2006/06/09 14:40 


S42 


3 


debug$6 with (VXML voicexml 
(voice adj xml)) and 
(@ad<"20011221" 
@prad<"20011221" 
@riad<"20011221") 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBMJTDB 


OR 


ON 


2006/06/09 14:48 



6/10/2006 3:02:49 PM 

C:\Documents and Settings\mtecklu\My Documents\EAST\Workspaces\10028355.wsp 
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Browsing: Building voiceXML browsers with openVXI 
Brian Eberman, Jerry Carter, Darren Meyer, David Goddeau 

May 2002 Proceedings of the 11th international conference on World Wide Web 

Publisher: ACM Press 

Full text available: ^ Ddf(209.58 KB) Additional Information: full citation , abstract , references , index terms 

The OpenVXI is a portable open source based toolkit that interprets the VoiceXML dialog 
markup language. It is designed to serve as a framework for system integrators and 
platform vendors who want to incorporate VoiceXML into their platform. A first version of 
the toolkit was released In the winter of 2001, with a second version released in 
September of 2001. A number of companies and individuals have adopted the toolkit for 
their platforms. In this paper we discuss the architecture of the toolk ... 



Keywords: openVXI, voiceXML 



MixedHnitiative interaction = mixed computation 

Naren Ramakrishnan, Robert G. Capra, Manuel A. Perez-Quinones 

January 2002 ACM SIGPLAN Notices , Proceedings of the 2002 ACM SIGPLAN 

workshop on Partial evaluation and semantics-based program 

manipulation PEPM '02, Volume 37 issue 3 
Publisher: ACM Press 

Full text available: godfd 98.73 KB) Additional Information: fuilc^ation . abstract, references , ciflngs. index 

We show that partial evaluation can be usefully viewed as a programming model for 
realizing mixed-initiative functionality in interactive applications. Mixed-initiative 
interaction between two participants is one where the parties can take turns at any time 
to change and steer the flow of interaction. We concentrate on the facet of mixed- 
initiative referred to as 'unsolicited reporting' and demonstrate how out-of-turn 
Interactions by users can be modeled by 'jumping ahead' to nested dialogs (via ... 

Keywords: Mixed-initiative interaction, VoiceXML, dialog management, interaction 
sequences, partial evaluation 



An open architecture for next-generation telecommunication services 
Gregory W. Bond, Eric Cheung, K. Hal Purdy, Pamela Zave, J. Christopher Ramming 
February 2004 ACM Transactions on Internet Technology (TOIT), Volume 4 issue i 

Publisher: ACM Press 

Full text available' fS\ pdf(237 24 KB) Additional Information: full citation , abstract , references , citings , index 

terms 
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An open (in the sense of extensible and programmable) architecture for IP 
telecommunications must be based on a comprehensive strategy for managing feature 
interaction. We describe our experience with BoxOS, an IP telecommunication platform 
that implements the DFC technology for feature composition. We present solutions to 
problems, common to all efforts in IP telecommunications, of feature distribution, 
interoperability, and media management. We also explain how BoxOS addresses many 
deficiencie ... 



Keywords: Component architectures, Intelligent Network architecture. Session Initiation 
Protocol, electronic mail, feature interaction, instant messaging, multimedia systems, 
network addressing, network interoperation, network optimization, network protocols, 
service creation 



Automated systematic testing for constraint-based interactive sei^ices 
Patrice Godefroid, Lalita J. Jagadeesan, Radha Jagadeesan, Konstantin Laufer 
November 2000 ACM SIGSOFT Software Engineering Notes , Proceedings of the 8th 
ACM SIGSOFT international symposium on Foundations of software 
engineering: twenty-first century applications SIGSOFT 'OO/FSE-8, 
Volume 25 Issue 6 
Publisher: ACM Press 

Full text available- "S pdfd.oe MB) Additional Information: full citation , abstract , references , citings , index 
' *^ * terms 

Constraint-based languages can express in a concise way the complex logic of a new 
generation of interactive services for applications such as banking or stock trading, that 
must support multiple types of interfaces for accessing the same data. These include 
automatic speech-recognition interfaces where inputs may be provided in any order by 
users of the service. We study in this paper how to systematically test event-driven 
applications developed using such languages. We show how such applic ... 

Keywords: constraint-based languages, interactive services, model checking, state 
explosion, state-space reduction, testing, verification 



5 Spoken dialogue technology: enabling the conversational user interface | 
Michael F. McTear 

March 2002 ACM Computing Surveys (CSUR), volume 34 issue i 
Publisher: ACM Press 

Full text available- fiHl pdf( 987 69 KB) Additional Information: full citation , abstract , references , citings , index 
. yyjj_v : terms , review 

Spoken dialogue systems allow users to interact with computer-based applications such 
as databases and expert systems by using natural spoken language. The origins of spoken 
dialogue systems can be traced back to Artificial Intelligence research in the 1950s 
concerned with developing conversational interfaces. However, it Is only within the last 
decade or so, with major advances in speech technology, that large-scale working 
systems have been developed and, in some cases, introduced into commerc ... 

Keywords: Dialogue management, human computer interaction, language generation, 
language understanding, speech recognition, speech synthesis 



6 Posters & demos: WebContext: remote access to shared context Q 
Robert G. Capra, Manuel A. Perez-Qulnones, Naren Ramakrishnan 

November 2001 Proceedings of the 2001 workshop on Perceptive user interfaces PUI 
-01 

Publisher: ACM Press 

Full text available: ^odfn 36.48 KB) Additional Information: full citation , abstract , references , citings 

In this paper, we describe a system and architecture for building and remotely accessing 
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shared context between a user and a computer. The system is designed to allow a user to 
browse web pages on a personal computer and then remotely make queries about 
information seen on the web pages using a telephone-based voice user interface. 

Keywords: VoiceXI^U information access, shared context, software architecture, 
telephone-based user interfaces, voice user interfaces 



The <bigwig> project 

Claus Brabrand, Anders Moller, Michael 1. Schwartzbach 

May 2002 ACM Transactions on Internet Technology (TOIT), volume 2 issue 2 
Publisher: ACIVI Press 

Full text available* Ddf(586 33KB) ^^^'^'^'^^^ Information: full citation , abstract , references , citings , index 
* ^ terms 

We present the results of the <bigwjg> project, which aims to design and implement a 
high-level domain-specific language for programming interactive Web services. 

A fundamental aspect of the development of the World Wide Web during the last decade 
is the gradual change from static to dynamic generation of Web pages. Generating Web 
pages dynamically in dialog with the client has the advantage of providing up-to-date and 
tailor-made information. The development of systems ... 

Keywords: Interactive Web services, program analysis 



8 Surfing the net for software engineering notes: Surfing the net for software Q 

engineering notes 
Mark Doernhoefer 

May 2004 ACM SIGSOFT Software Engineering Notes, Volume 29 issue 3 
Publisher: ACM Press 

Full text available: ^pdf(1.47 MB) Additional Information: full citation 




9 Programming by voice. VocalProgramming Q 
^ Stephen C. Arnold, Leo Mark, John Goldthwaite 

November 2000 Proceedings of the fourth international ACM conference on Assistive 
technologies 

Publisher: ACM Press 

Full text available: ^pdf(92.05 KB) Additional Information: full citation , references , index terms 



Keywords: XML, computer programming, voice recognition 



10 Towards iunking the PBX: deploying IP telephony 
^ Wenyu Jiang, Jonathan Lennox, Henning Schulzrinne, Kundan Singh 

January 2001 Proceedings of the 11th international workshop on Networic and 
operating systems support for digital audio and video 

Publisher: ACIVI Press 

Full text ava»lable:- mDdf(312.40KB) '"fo^^^^tion: full citation , abstract, references, dtings. index 

terms 

We describe the architecture and implementation of our Internet teleph ony test-bed 
intended to replace the departmental PBX (telephone switch). It interworks with the 
traditional telephone networks via a PSTN/IP gateway. It also serves as a corporate or 
campus infrastructure for existing and future services like web, email, video and 
streaming media. Initially intended for a few users, It will eventually replace the plain old 
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telephones from our offices, due to the cost benefit and new ... 

Keywords: PSTN/IP interoperability, SIP, VoIP test-bed, internet telephony deployment 
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11 Tempus fight and the need for an e-social contract 
James Kaufman, Joann Ruvolo, Daniel Ford 

May 2001 Proceedings of the fifth international conference on Autonomous agents 

Publisher: ACM Press 

Full text available- 151 pdfd 14 22 KB) Additional Information: full citation , abstract , references , citings , index 

terms 

For autonomous agents to achieve their full potential they require access to detailed 
private information. The time is rapidly approaching when we can build systems to gather 
this information and monitor all aspects of an individual's life. In this paper we describe 
Tempus Fugit (Time Flies), an attempt to create just such a system. The reality of this 
technology has enormous social implications and, misused, it creates direct threats to 
liberty. We further describe an ''e-Soclal Contr ... 

Keywords: active calendar, agent, calendar, personal information management system, 
social contract 



12 Toolkits: Revisiting visual interface programming: creating GUI tools for designers 
^ and programmers 

^ Stephane Chatty, Stephane Sire, Jean-Luc Vinot, Patrick Lecoanet, Alexandre Lemort, 
Christophe Mertz 

October 2004 Proceedings of the 17th annual ACM symposium on User interface 
software and technology 

Publisher: ACM Press 

Full text available: ^ pdfM.H MB) Additional Information: full citation , abstract , references , index terms 

Involving graphic designers in the large-scale development of user interfaces requires 
tools that provide more graphical flexibility and support efficient software processes. 
These requirements were analysed and used in the design of the TkZ-inc graphical library 
and the IntuiKit interface design environment. More flexibility is obtained through a wider 
palette of visual techniques and support for iterative construction of images, composition 
and parametric displays. More efficient processes ... 

Keywords: GUI tools, SVG, model-driven architecture, software architecture, vector 
graphics, visual design 
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13 Scenarios of using web services in M-commerce Q 
T. Pllloura, A. Tsalgatidou, S. Hadjiefthymlades 
December 2002 ACM SIGecom Exchanges, volume 3 issue 4 

Publisher: ACM Press 

Full text available: W\ pdf(208.29 KB) Additional Information: full citation , abstract , references , index terms 



The web service paradigm is a promising technology for developing applications In open, 
distributed and heterogeneous environments. The proliferation of this new technology has 
coincided with significant advances in the hardware and software capabilities of mobile 
devices. Due to the great benefits that come with the web service technology, such as 
interoperability, dynamic service discovery and reusability, there is a strong Interest In 
making mobile devices capable of providing and consuming w ... 

Keywords: m-commerce, web services, wireless devices 
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^ making semantic connections 

^ Daniel A. Ford, Joann Ruvolo, Stefan Ediund, Jussi Myllymaki, James Kaufman, Jared 
Jackson, Martin Gerlach 

October 2001 Proceedings of the tenth international conference on Information and 

i<nowledge management 
Publisher: ACM Press 

Full text available* t?l pdf(2 14 MB) Additional Information: full citation , abstract , references , citings , index 

'™ terms 

Tempus Fugit ("Time Files") is the first of a new generation of Personal Information 
Management (PIM) systems. A PIM system incorporates an electronic calendar, "to-do" 
list and address book. The premise behind Tempus Fugit is that information stored in 
electronic calendars, to-do lists and address books can be given richer semantic 
interpretation and automatically processed to make its users more effective. Tempus Fugit 
also tracks the physical and virtual locations of users and uses thi ... 

Keywords: PIM, active calendar, electronic address book, electronic calendar, location 
based services, location tracking, mobile productivity, personal information management, 
software agents 
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Browsing: Building voiceXML browsers with openVXI 
Brian Eberman, Jerry Carter, Darren Meyer, David Goddeau 

May 2002 Proceedings of the 11th international conference on World Wide Web 
Publisher: ACM Press 

Full text available: ^ pdf(209.58 KB) Additional Information: full citation , abstract , references , index terms 

The OpenVXI Is a portable open source based toolkit that interprets the VoiceXML dialog 
markup language. It is designed to serve as a framework for system integrators and 
platform vendors who want to incorporate VoiceXML into their platform. A first version of 
the toolkit was released in the winter of 2001, with a second version released in 
September of 2001. A number of companies and Individuals have adopted the toolkit for 
their platforms. In this paper we discuss the architecture of the toolk ... 



Keywords: openVXI, voiceXML 



2 VoiceXML for Web-based distributed conversational applications 
Bruce Lucas 

September 2000 Communications of the ACM, Volume 43 issue 9 
Publisher: ACM Press 

Full text available: ^ pdf(7971 KB) * 

is r «^ Additional Information: full citation , citings , index terms 
gj] html(21.89 KB) 



Posters: XISL: a language for describing multimodal interaction scenarios 

Kouichi Katsurada, Yusaku Nakamura, HirobumI Yannada, Tsuneo Nitta 

November 2003 Proceedings of the 5th international conference on Multimodal 

interfaces 
Publisher: ACM Press 

Full text available: ^pdf(152.59 KB) Additional Information: full citation , abstract , references , index terms 

This paper outlines the latest version of XISL (extensible Interaction Scenario Language). 
XISL is an XML-based markup language for web-based multimodal interaction systems. 
XISL enables to describe synchronization of multimodal inputs/outputs, dialog 
flow/transition, and some other descriptions required for multimodal Interaction. XISL 
inherits these features from VoiceXML and SMIL. The original feature of XISL Is that XISL 
has enough modality-extensibility. We present the basic XISL tags, outi ... 

Keywords: XISL, XML, modality extensibility, multimodal Interaction 
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4 WebViews: accessing personalized web content and services 
Juliana Freire, Bharat Kumar, Daniel Lieuwen 

April 2001 Proceedings of the 10th international conference on World Wide Web 
Publisher: ACM Press 

Full text available: ^ pdf(305.83 KB) Additional Information: full citation , references , citings , index terms 




Keywords: Web clipping, content transcoding, dynamic content, electronic commerce, 
information delivery, personalization, smart bookmarks, voice interfaces, wrappers 



5 Connponent'based multimodal dialog interfaces for nnobile knowledge creation 

Georg Niklfeld, Robert FInan, Michael Pucher 

July 2001 Proceedings of the workshop on Human Language Technology and 
Knowledge Management - Volume 2001 

Publisher: Association for Computational Linguistics 

Full text available: ^ pdf(55,75 KB) Additional Information: full citation , abstract , references 

This paper addresses two related topics: Firstly, it presents building-blocks for flexible 
multimodal dialog interfaces based on standardized components (VoiceXML, XML) to 
indicate that thanks to well-supported standardizations, mobile multimodal Interfaces to 
heterogeneous data sources are becoming ready for mass-market deployment, provided 
that adequate modularization Is respected. Secondly, this is put in the perspective of a 
discussion of knowledge management in firms, and the paper argues t ... 

6 Posters & demos: WebContext: remote access to shared context 
Robert G. Capra, Manuel A. Perez-Quinones, Naren Ramakrishnan 

November 2001 Proceedings of the 2001 workshop on Perceptive user interfaces PUI 
'01 

Publisher: ACM Press 

Full text available: ^ pdf( 136.48 KB) Additional Information: full citation , abstract , references , citings 

In this paper, we describe a system and architecture for building and remotely accessing 
shared context between a user and a computer. The system Is designed to allow a user to 
browse web pages on a personal computer and then remotely make queries about 
information seen on the web pages using a telephone-based voice user interface. 

Keywords: VoiceXML, Information access, shared context, software architecture, 
telephone-based user interfaces, voice user interfaces 
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Mixed-initiative interaction = mixed computation 

Naren Ramakrishnan, Robert G. Capra, Manuel A. Perez-Quinones 

January 2002 ACM SIGPLAN Notices , Proceedings of the 2002 ACM SIGPLAN 

workshop on Partial evaluation and semantics-based program 

manipulation PEPM '02, Volume 37 issue 3 
Publisher: ACM Press 

Full text available- fi!ipdfn98 73 KB^ Additional Information: full citation , abstract , references , citings , index 
' 1^ terms 

We show that partial evaluation can be usefully viewed as a programming model for 
realizing mixed-initiative functionality in interactive applications. Mixed-initiative 
interaction between two participants is one where the parties can take turns at any time 
to change and steer the flow of Interaction. We concentrate on the facet of mixed- 
initiative referred to as 'unsolicited reporting' and demonstrate how out-of-turn 
interactions by users can be modeled by 'jumping ahead' to nested dialogs (via ... 

Keywords: Mixed-initiative interaction, VoiceXML, dialog management, interaction 
sequences, partial evaluation 
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August 2005 Proceedings of the 11th annual international conference on Mobile 

computing and networking MobiCom '05 
Publisher: ACM Press 

Full text available: Ddf(987.54 KB^ Additional Information: full citation , abstract , references , index terms 

Interaction design is a major issue for mobile information systems in terms of not only the 
choice of input-output channels and presentation of information, but also the application 
of context-awareness. To support experimentation with these factors, we have developed 
a platform that supports the rapid prototyping of multi-channel, multi-modal, context- 
aware applications. The paper presents the main components of the platform and 
describes how It was used to develop a tourist information system ... 

Keywords: interactive paper, mobile information system, rapid prototyping, tourist 
guide, voice interface, web publishing 

9 Spoken dialogue technology: enabling the conversational user interface 
Michael F. McTear 

March 2002 ACM Computing Surveys (CSUR), Volume 34 issue i 
Publisher: ACM Press 

Full text available: f gl pdf(987.69 KB^ Additional Information: full citation , abstract, references , citings, index 

terms , review 

Spoken dialogue systems allow users to interact with computer-based applications such 
as databases and expert systems by using natural spoken language. The origins of spoken 
dialogue systems can be traced back to Artificial Intelligence research in the 1950s 
concerned with developing conversational interfaces. However, it is only within the last 
decade or so, with major advances in speech technology, that large-scale working 
systems have been developed and, In some cases. Introduced into commerc ... 

Keywords: Dialogue management, human computer interaction, language generation, 
language understanding, speech recognition, speech synthesis 



10 Demonstrations: WinAgent: a system for creating and executing personal information m 

assistants using a web browser 
^ Nikeeta Julasana, Akshat Khandelwal, Anupama Lolage, Prabhdeep Singh, Priyanka 
Vasudevan, Hasan Davulcu, I. V. Ramakrishnan 

January 2004 Proceedings of the 9th International conference on Intelligent user 

interface 
Publisher: ACM Press 

Full text available: ^ pdf(334.60 KB) Additional Information: full citation , abstract , references , index terms 

WinAgent is a software system for creating and executing Personal Information Assistants 
(PIAs), These are software robots that can locate and extract targeted data buried deep 
within a web site. They do so by automatically navigating to relevant sites, locating the 
correct Web pages (which can be either directly accessed by traversing appropriate links 
or by filling out HTML forms), and extracting, structuring, and organizing data of interest 
from these pages into XML The primary thrust of Win ... 

Keywords: XML, agents, browser, machine learning, web 
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Keywords: audio output, audio/keyboard input, web page partitioning, web-based 
assistive course managennent, web-content analysis 



12 Commerce and Businesses: A voice and ink XML multimodal architecture for mobile Q 
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^ Zouheir Trabelsi, Sung-Hyuk Cha, Darshan Desai, Charles Tappert 

September 2002 Proceedings of the 2nd international workshop on Mobile commerce 

Publisher: ACM Press 

Full text available: Q pdf(445.55 KB^ Additional Information: full citation , abstract , references , index terms 

This paper presents a multimodal interface architecture that combines standardized voice 
and ink formats to facilitate the creation of robust and efficient multimodal mobile e- 
Commerce systems, particularly for noisy mobile environments. The platform provides a 
Web interactive system for generic multimodal application development. By providing 
mutual disambiguation of input signals and superior error handling this architecture 
should broaden the spectrum of users to the general population, inclu ... 

Keywords: InkXML, VoiceXML, handwriting recognition, multimodal applications, mutual 
disambiguation, speech recognition 
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user interfaces 

Oscar Mayora -Ibarra, Oscar de la Paz-Arroyo, Edgar Cambranes-Martmez, Alejandro 
Fuentes-Penna 

August 2003 Proceedings of the Latin American conference on Human-computer 

interaction CLIHC *03 
Publisher: ACM Press 

Full text available: ^ pdf(450.37 KB) Additional Information: full citation , abstract , references 

The promise of Information anytime, anywhere has become a reality. Today, it is possible 
to access information through multiple kinds of devices. However, the design of user 
Interfaces for such devices is restricted to the use of specific adhoc programming 
languages that may vary from one device to the other. In this sense, the existence of 
generic programming languages for creating device-independent user interfaces is 
becoming a strong necessity. One emerging approach to device independent dev ... 

Keywords: J2ME, UIML, VXML, WML, XSLT, generic vocabulary, visual programming 
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Publisher: ACM Press 

.. . ^ -I ui 01 ^^/ooT nA t^Dv Additional Information: full citation , abstract , references , citings . Index 

Full text available: TO pdf(237.24 KB^ ^ 

terms 

An open (in the sense of extensible and programmable) architecture for IP 
telecommunications must be based on a comprehensive strategy for managing feature 
interaction. We describe our experience with BoxOS, an IP telecommunication platform 
that Implements the DFC technology for feature composition. We present solutions to 
problems, common to all efforts in IP telecommunications, of feature distribution, 
interoperability, and media management. We also explain how BoxOS addresses many 
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service creation 



15 Posters: A transformational approach for multimodal web user interfaces based on Q 
^ UsiXML 

^ Adrian Stanciulescu, Quentin Limbourg, Jean Vanderdonckt, Benjamin MIchotte, Francisco 
Montero 

October 2005 Proceedings of the 7th international conference on Multimodal 
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Publisher: ACM Press 

Full text available: ^ pdf(700.15 KB) Additional Information: full citation , abstract , references , index temris 

A transfornnational approach for developing multimodal web user Interfaces is presented 
that progressively moves from a task model and a domain model to a final user interface. 
This approach consists of three steps: deriving one or many abstract user interfaces from 
a tasl< model and a domain model, deriving one or many concrete user interfaces from 
each abstract one, and producing the code of the corresponding final user Interfaces. To 
ensure these steps, transformations are encoded as graph tran ... 

Keywords: model-driven development, multimodal interaction, transformational 
approach, user interface extensible markup language 



Automated systematic testing for constraint-based interactive services 
^ Patrice Godefroid, Lalita J. Jagadeesan, Radha Jagadeesan, Konstantin Laufer 

November 2000 ACi^ SIGSOFT Software Engineering Notes , Proceedings of the 8th 
ACM SIGSOFT international symposium on Foundations of software 
engineering: twenty-first century applications SIGSOFT 'OO/FSE-8, 
Volume 25 Issue 6 

Publisher: ACM Press 

cr II * ^ I ui 01 Af/^ ne Additional Information: full citation , abstract , references , citings , index 

Full text available: pare 1.06 IviB) ^* 

terms 

Constraint-based languages can express in a concise way the complex logic of a new 
generation of interactive services for applications such as banking or stock trading, that 
must support multiple types of interfaces for accessing the same data. These include 
automatic speech-recognition interfaces where Inputs may be provided in any order by 
users of the service. We study In this paper how to systematically test event-driven 
applications developed using such languages. We show how such applic ... 

Keywords: constraint-based languages, interactive services, model checking, state 
explosion, state-space reduction, testing, verification 



17 Multimedia: Streaming speech ^ : a framework for generating and streaming 3D text- Q 
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Stuart Goose, Sreedhar Kodlahalli, William Pechter, Rune Hjelsvold 

May 2002 Proceedings of the 11th international conference on World Wide Web 

Publisher: ACM Press 

Full text available: IflMCmilKBi Additional Information: full citation , abstract, references , citings, index 
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While monochrome unformatted text and richly colored graphical content are both capable 
of conveying a message, well designed graphical content has the potential for better 
engaging the human sensory system. It Is our contention that the author of an audio 
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presentation should be afforded the benefit of judiciously exploiting the human aural 
perceptual ability to deliver content in a more compelling, concise and realistic manner. 
While contemporary streaming media players and voice browsers share ... 

Keywords: 3D audio, PDA, SI^IIL, accessibility, location-based, mobile, spatialization, 
speech synthesis, streaming, wireless 

Extending Java for high-level Web service construction ||| 
Aske Simon Christensen, Anders M0ller, Michael I. Schwartzbach 
November 2003 ACM Transactions on Programming Languages and Systems 

(TOPLAS); Volume 25 Issue 6 
Publisher: ACM Press 

Full text available- IS Ddf(947 02 KB) Additional Information: full citation , abstract , references , citings , index 
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We incorporate innovations from the <bigwig> project Into the Java language to provide 
high-level features for Web service programming. The resulting language, JWIG, contains 
an advanced session model and a flexible mechanism for dynamic construction of XML 
documents, in particular XHTML. To support program development we provide a suite of 
program analyses that at compile time verify for a given program that no runtime errors 
can occur while building documents or receiving form input, and ... 

Keywords: Interactive Web services, XML, data-flow analysis 

19 A scalable formal method for design and automatic checking of user interfaces ^ 
Jean Berstel, Stefano Crespi Reghizzi, Gilles Roussel, Pierluigi San Pietro 
April 2005 ACM Transactions on Software Engineering and Methodology (TOSEM), 

Volume 14 Issue 2 
Publisher: ACM Press 

Full text available: ^ pdf(1.74MB) Additional Information; full citation , abstract , references , index terms 

The article addresses the formal specification, design and implementation of the 
behavioral component of graphical user interfaces. The complex sequences of visual 
events and actions that constitute dialogs are specified by means of modular, 
communicating grammars called VEG (Visual Event Grammars), which extend traditional 
BNF grammars to make them more convenient to model dialogs.A VEG specification is 
independent of the actual layout of the GUI, but it can easily be integrated with various 
la ... 

Keywords: GUI design. Human -computer interaction (HCI), applications of model 
checking 

20 Improving the browsing experience: A framework for coordinated multi-modal Q 
^ browsing with multiple clients 

^ Alistair Coles, Eric Deliot, Tom Melamed, Kevin Lansard 

IVlay 2003 Proceedings of the 12th international conference on World Wide Web 

Publisher: ACM Press 

Full text available:- mDdf(111.38 KB) Additional Information: full citation , abstrad. references , dtings. index 

terms 

As users acquire or gain access to an increasingly diverse range of web access clients, 
web applications are adapting their user Interfaces to support multiple modalities on 
multiple client types. User experiences can be enhanced by clients with differing 
capabilities combining to provide a distributed user interface to applications. Indeed, 
users will be frustrated if their Interaction with applications is limited to one client at a 
time.This paper discusses the requirements for coordinating we ... 

Keywords: multi-modal browsing, web proxy 
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